Goto

Collaborating Authors

 generalised distributive property



Appendix A Generalised Distributive Property

Neural Information Processing Systems

The Distributive Law is an extremely useful tool for analysis and computation in mathematics and computer science. It can also be used to make algorithms more memory-efficient. For example, if we wish to take the DFT of a shifted signal, we can avoid storing the signal itself. While the Distributive Law is defined for the group of real numbers under additivity (R, +), we can also define a more general distributive property for the Abelian group defined by an aggregator ( R, null) . Note that while our solution holds for any function f, it focuses on the special cases α = 0,β = 0 and α = 1,β = 0 .


Generalised f-Mean Aggregation for Graph Neural Networks

Kortvelesy, Ryan, Morad, Steven, Prorok, Amanda

arXiv.org Artificial Intelligence

Graph Neural Network (GNN) architectures are defined by their implementations of update and aggregation modules. While many works focus on new ways to parametrise the update modules, the aggregation modules receive comparatively little attention. Because it is difficult to parametrise aggregation functions, currently most methods select a ``standard aggregator'' such as $\mathrm{mean}$, $\mathrm{sum}$, or $\mathrm{max}$. While this selection is often made without any reasoning, it has been shown that the choice in aggregator has a significant impact on performance, and the best choice in aggregator is problem-dependent. Since aggregation is a lossy operation, it is crucial to select the most appropriate aggregator in order to minimise information loss. In this paper, we present GenAgg, a generalised aggregation operator, which parametrises a function space that includes all standard aggregators. In our experiments, we show that GenAgg is able to represent the standard aggregators with much higher accuracy than baseline methods. We also show that using GenAgg as a drop-in replacement for an existing aggregator in a GNN often leads to a significant boost in performance across various tasks.